# Masked language model

Italian ModernBERT is a specialized version of ModernBERT for Italian language, pre-trained specifically on Italian text.

BARTSmiles is a generative masked language model based on the BART architecture, specifically designed for molecular representation and SMILES string processing.

PhayaThaiBERT is a foundational BERT model based on the Thai language, suitable for Thai text processing tasks.

GPN-MSA is a language model trained on human and 89 other vertebrate species, specializing in DNA sequence analysis and variant effect prediction.

RuLeanALBERT is a memory-efficient masked language model pretrained specifically for Russian.

This is a RoBERTa model pretrained on the CC-100 dataset, suitable for Belarusian text processing tasks.

This is a masked language model focused on the Tswana language, aiming to enhance the performance of low-resource South African languages in the field of NLP.

AlephBERT is a cutting-edge language model for Hebrew, based on Google's BERT architecture, specifically designed for processing Hebrew text.

VetBERT is a pretrained language model specifically designed for processing veterinary clinical notes, further trained on veterinary medical domain data based on Bio_ClinicalBERT.

This is a RoBERTa model pre-trained on the CodeSearchNet dataset, specifically designed for Golang masked language modeling tasks.

tunbert_zied is a language model based on the Tunisian dialect, with an architecture similar to RoBERTa, trained on over 600,000 Tunisian dialect phrases.

This is a RoBERTa model pre-trained on Thai Wikipedia text, using character-level embeddings to adapt to BertTokenizerFast.

A small Japanese RoBERTa model pre-trained on Aozora Bunko texts, suitable for various downstream NLP tasks

This is a BERT model pre-trained on Japanese Wikipedia text, derived from bert-large-japanese-char, with enhanced character embedding capabilities to support more Kanji characters.

A RoBERTa model pretrained on Aozora Bunko texts using a character tokenizer, suitable for Japanese text processing tasks.